Check a prototype of 2nd version of this platform
being developed by cKnowledge.org in collaboration with
MLCommons.
crowdsource experiment
ck-action:crowdsource experiment (v3.0.0)
License: BSD 3-clause (code) and CC BY-SA 4.0 (data)
Creation date: 2014-12-06
Source: GitHub
cID: 081173242a88bc94:48cc80366de6ab0d
Don't hesitate to get in touch if you encounter any issues or would like to discuss this community project!
Creation date: 2014-12-06
Source: GitHub
cID: 081173242a88bc94:48cc80366de6ab0d
Description
- Automation framework: CK
- Development repository: ck-ml
- Source: GitHub
- How to get the stable version via the CK client:
pip install cbench
cb download module:experiment --version=3.0.0 --all
ck crowdsource experiment --help - How to get the development version:
pip install ck
ck pull repo:ck-ml
ck crowdsource experiment --help
- How to run from Python:
import ck.kernel as ck
r=ck.access({'action':'',
'module_uoa':'',
... See JSON API below ...
})
if r['return']>0: return r
...
- Module description: universal experiment entries
- API Python code: Link
- JSON API:
" Input: { (scenario) - UOA of a module with crowdsourcing scenario (tags) - tags to prune experimental scenarios (quiet) - do not ask questions, but select random ... (skip_welcome) - if 'yes', do not print welcome header (skip_exchange) - if 'yes', do not exchange platform info (development mode) (change_user) - if yes', change user (local) - if 'yes', use local repo for exchange (local autotuning/benchmarking) (exchange_repo) - which repo to record/update info (remote-ck by default) (exchange_subrepo) - if remote, remote repo UOA (once) - if 'yes', run scenario ones (useful for autotuning a given program) } Output: { return - return code = 0, if successful > 0, if error (error) - error text if return > 0 Output of the last scenario (important for mobile device experiment crowdsourcing) } "